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METHOD OF ERASING REPEATED PATTERNS AND 
PATTERN DEFECT INSPECTION DEVICE 

BACKGROUND OF THE INVENTION 
5 1. TECHNICAL FIELD OF THE INVENTION 

The present invention relates to a method of erasing 
repeated patterns and to a pattern defect detection device 
in image processing when detecting pattern defects contained 
in electronic equipment devices such as liquid crystal 
10 panels, plasma display panels, or semiconductor wafers* 
2. DESCRIPTION OF RELATED ART 

Conventionally, inspection of pattern defects in the 
manufacture of electronic equipment devices such as liquid 
crystal panels, plasma or display panels or semiconductor 
15 wafers was performed by visual inspection by human beings or 
by automatic image processing carried out by machine. 

In the case of visual inspection, alterations in the 
type of electronic equipment being inspected can easily be 
coped with, and start-up is rapid, but there are the 
20 drawbacks that identifying the precise positions of defects 
takes time and throughput is poor. Maintaining and 
standardizing detection sensitivity is also a problem. 

In contrast, in the case of image processing using a 
machine, although there are the advantages that rapid 
25 identification of the precise positions of defects and 
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maintenance and standardization of the detection sensitivity 
can be achieved, there was the problem that considerable 
time was required for adjustment in the event of alterations 
in the type of electronic equipment being manufactured. 

With increases in the structural fineness and 
performance of components in recent years, the poor 
throughput of visual inspection has become increasingly 
prominent. There are therefore considerable expectations in 
regard to improvement of performance of machines that 
perform image processing. 

However, although the structural fineness and 
performance of electronic equipment devices such as liquid 
crystal panels, plasma or display panels and semiconductor 
wafers has considerably increased, these devices are often 
formed with a large number of repeated patterns identical to 
a partial pattern. To detect defects in such repeated 
patterns, conventionally, processing was performed as 
follows . 

Firstly, pattern erasure is performed as described 

below by performing the processing: 

gout = gin - g(in + size) + offset 

on all the pixels of the raw image, including the 

imaged repetition pattern, that are within the processing 

region, with the standard pitch of the repetition pattern. 

Here, gout is the density of the pixels of the image after 



processing, gin is the density of the pixels of the raw 
image, g (in+size) is the density of a pixel separated by 
the standard pitch from the pixel chosen as the origin of 
the raw image, and offset is the density that is added as a 
reference density in the image after processing; in the case 
of 8-bit 256 gradations, this is usually the central 128 
gradations. This processing is called pattern erasure 
processing; the image obtained by this processing is called 
the background image or image after pattern erasure 
processing. 

Secondly, pixels whose density differs considerably 
from the background density of the background image are 
detected as defects. This processing is called defect 
detection processing. 

The description will now be continued with reference to 
Figure 5A and Figure 5B. Figure 5A shows the raw image 
prior to pattern erasure processing, in which an elongate 
pattern is repeated. Figure 5B shows the image after 
pattern erasure processing. The 21 pixels that are closest 
to the pattern pitch are taken as constituting the size in 
the expression given above for pattern erasure processing. 
Processing is performed in the range of processing region 50 
illustrated in Figure 5A. 

Also, at the bottom of Figure 5A and Figure 5B, there 
are shown the density profiles 53 and 54 on the check lines 



51, 52 respectively on the raw image prior to pattern 
processing and the image after processing. The direction of 
increased brightness is the direction of approach to 
gradation number 255; the direction of decreasing brightness 
5 is the direction approaching gradation 0. Whether or not 
the pattern has been erased after processing can be 
ascertained by comparing the density profiles 53 and 54. 

Defect detection processing consists detecting as a 
defect satisfaction of certain density conditions in the 
10 image after processing illustrated in Figure 5B. Taking as 
an example the density profile 54 on check line 52, if a 
density gradation of more than the specific density 
gradation 135 is deemed to constitute a white defect and a 
density gradation of less than specific density gradation of 
15 120 is deemed to constitute a black defect, 55 is detected 
as a black defect. 

However, in the above conventional pattern erasure 
processing, there are the following three problems. 

Firstly, normal portions of the pattern are left in the 
20 background image. 

Secondly, although they might originally be white 
defects or black defects, when both white defects and black 
defects occur in the background image, it becomes difficult 
to distinguish which kind of defects they originally were. 
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Thirdly, processing of the peripheral pattern cannot be 
performed normally. 

These are now described in detail below. 

The first problem does not arise if the pattern pitch 
5 is an integer at all locations. However, it is impossible 
for the pitch to be the same over the entire raw image. 
This is because, when image pickup is effected through a 
large number of lenses employed for image input, due to the 
effects of lens aberration, image pickup cannot be effected 
10 at exactly the same pitch in the center and periphery of the 
lenses. Also, it is difficult to make this an integer value 
with no error at all. Examples are the residual portions 58 
and 59 of Figure 5B. 

The second problem is a phenomenon that may occur due 
15 to comparison before and after. The white defect 56 in the 
middle of the processing region 50 of Figure 5A appears as 
defect portions 56 and 57 in Figure 5B which are of higher 
density and lower density than the background density. The 
distance between pixel 56 and pixel 57 is of course the size 
20 of the pattern erasure processing. It is therefore 

impossible to tell simply from an individual defect portion, 
whether the original defect was a white defect or a black 
defect . 

The third problem, like the second problem is a 
25 phenomenon that may occur due to comparison before and after. 
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When pattern erasure processing is performed over the entire 
input image, as shown in Figure 6A and Figure 6B, a region 
60 corresponding to the size of the pattern erasure 
processing on the right hand side of the region cannot be 
5 obtained as a result of normal processing • This is because 
there are no comparison pixels . 

SUMMARY OF THE INVENTION 
An object of the present invention is to solve the 

10 above problems and to provide a method of erasing repeated 
patterns in which inspection of defects in a repeated 
pattern can be performed without problems. 

A method of erasing repeated patterns according to the 
present invention comprises, in a dark/light image obtained 

15 by image pickup of a subject of inspection, when identifying 
defects present in a repeated pattern in a subject of 
inspection, a step of detecting a plurality of density 
differences in which the density differences are found 
between reference pixels separated by values of a pre- 

20 determined reference size and sizes which are integral 

multiples thereof and a plurality of comparison pixels, a 
step of determining a specific density difference wherein 
the density difference that is closest to 0 or the mean 
density difference from a plurality of density differences 

25 is detected as specific density difference, and a pattern- 
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erased image generation step in which the specific density 
difference is applied to the reference density in the 
pattern-erasure image; by detecting the specific density 
differences using the density differences with respect to a 
5 plurality of comparison pixels, the problems mentioned above 
are eliminated and a repeated pattern can be suitably erased 
without using a complicated algorithm. 

Also, a pattern defect inspection device according to 
the present invention comprises an image pickup element that 

10 picks up an image of an inspection subject and a processing 
device that detects pattern defects by storing and 
processing dark/light image data obtained by image pickup of 
the inspection subject wherein the processing device 
comprises: a portion for detecting a plurality of density 

15 differences in which the density differences are found 
between reference pixels separated by a pre-determined 
reference size and sizes which are integral multiples 
thereof and a plurality of comparison pixels; a specific 
density difference determining portion wherein the density 

20 difference that is closest to 0 from a plurality of density 
differences is detected, a pattern-erased image generation 
portion in which the specific density difference is applied 
to the reference density in the pattern-erasure image; and a 
defect detection portion; thus the repeated pattern can be 
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erased and pattern defects detected in a suitable way as 
described above. 

Other and further objects, features and advantages of 
the invention will appear more fully from the following 
5 description. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 is a layout diagram of a pattern defect 
inspection device wherein an embodiment of a method of 
10 erasing repeated patterns according to the present invention 
is applied; 

Figure 2 is a processing flow chart of a repeated 
pattern erasure method according to the above embodiment; 

Figure 3 is a diagram of filter elements in this 
15 embodiment; 

Figure 4A and Figure 4B are diagrams of images before 
and after processing in this embodiment; 

Figure 5A and Figure 5B are diagrams of images before 
and after processing by a repeated pattern erasure method 
20 according to a prior art example; and 

Figure 6A and Figure 6B are diagrams of images before 
and after processing illustrating a region which is 
incapable of being processed in the prior art example. 

25 DESCRIPTION OF PREFERRED EMBODIMENTS 
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An embodiment in which a repeated pattern erasure 
method and pattern defect inspection device according to the 
present invention are applied to inspection of an electrode 
wiring glass panel in a liquid crystal array panel is 
5 described below with reference to Figure 1 to Figure 4. 

In Figure 1, which illustrates diagrammatically the 
construction of a pattern defect inspection device according 
to the present invention, the subject of inspection 1 is 
arranged in a prescribed position and is supplied with 
^ 10 illumination by downward illumination 2, and an image 
Hi thereof is picked up by an image pickup element comprising a 

§2 CCD area sensor etc. The image data from the sensor pixels 

U in image pickup element 3 is transferred, in one-to-one 

Q correspondence, to image memory 5 in a computer 4 

U 15 constituting a processing device* The image data 
3 transferred into this image memory 5 is read to computer 4 

and a processing program 6 is stored that performs 
prescribed processing. The image density is processed in 
256 gradations, namely, 0 to 255. 
20 Figure 2 shows the flow of processing of the method of 

detection of defects by repeated pattern erasure. In Figure 
2, first of all, in image input step No. 1, the image data 
that is obtained from image pickup element 3 is stored in 
image memory 5 of computer 4. Next, in a plurality of 
25 density difference detection steps of step No. 2, the 
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* * 

following processing is performed with the size (21 pixels) 
found beforehand from the pattern pitch. The density 
differences between reference pixels and a plurality of 
comparison pixels separated by a value of an integral 
5 multiple of the aforesaid size are thereby found, 
gout-n = gin - g (in+size*n) -(1) 
The reference pixels and comparison pixels are called 
filter elements. Figure 3 shows the relationship of filter 
elements at the positions of particular reference pixels. 

10 Reference pixels 11, 12, 13, 14 are set up that are 

separated by values of integral multiples of the size with 
respect to reference pixel 10. Four density differences are 
obtained by expression (1). These are designated gout-1, 
gout-2 , gout-3 and gout-4 . 

15 Next, in the specific density difference determination 

step of step No. 3, the final output densities are 
determined from the four density differences gout-1, gout-2, 
gout-3, and gout-4 of expression (1). In the case where the 
object is pattern erasure, the value of these values which 

20 is closest to 0 is selected. For example, if gout-1 = 3, 
gout-2 = -2, gout-3 = 10, and gout-4 = -9, gout-2 is 
selected as the specific density difference. 

Next, in the erased image generation step of step No. 4, 
the specific density difference found in the specific 

25 density difference determination step is added to the 
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reference density in the pattern erasure image . The 
reference density is determined in the same way as the 
offset described in the prior art example; in the case of 
256 8-bit gradations of 0 to 255 , the reference density will 
5 often be gradation 128. 

Figure 4A is an image which has a repeated elongated 
pattern prior to pattern erasure processing and Figure 4B is 
the image after processing. Even if processing is performed 
on the entire input image area, the first to third problems 
S 10 of the prior art example are solved. White defect 20 and 
P black defects 21, 22, 23, and 24 respectively appear in the 

^ image after processing as an independent white defect and 

5 independent black defects. Also, normal processing can be 

i*j performed over the entire area of the image and the pattern 

d 15 can be reliably erased. 

□ Although, in the description of the above embodiment, 

in the step of determining the specific density difference, 
the specific density difference that was closest to 0 was 
selected, depending on the circumstances, the mean value of 

20 a plurality of density differences could be selected as the 
specific density difference. 

Since, with the method of erasing repeated patterns and 
pattern defect inspection device according to the present 
invention, there are provided a step of detecting a 

25 plurality of density differences in which the density 
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differences are found between reference pixels separated by 
the value of a reference size which was previously found as 
described above and values of integral multiples thereof and 
a plurality of comparison pixels, a step of determining a 
5 specific density difference wherein the density difference 
that is closest to 0 or the mean density difference is 
detected as specific density difference from a plurality of 
density differences, and a pattern-erased image generation 
step in which the specific density difference is applied to 

10 the reference image of the pattern-erasure image, the 

problems of the prior art are solved, and, without using a 
complicated algorithm, the repeated pattern can be suitably 
erased, making it possible to detect pattern defects. 

Although the present invention has been fully described 

15 in connection with the preferred embodiment thereof, it is 
to be noted that various changes and modifications apparent 
to those skilled in the art are to be understood as included 
within the scope of the present invention as defined by the 
appended claims unless they depart therefrom. 

20 
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CLAIMS 

WHAT IS CLAIMED IS: 

1. A method of erasing repeated patterns in a 
dark/light image obtained by image pickup of a subject of 
inspection, when identifying defects present in a repeated 
pattern in a subject of inspection, comprising the 
procedures of: 

demarcating the obtained image into a plurality of 
areas ; 

detecting a reference pixel in one of said demarcated 
areas; 

assigning a comparison pixel in each of the rest of 
said demarcated areas; 

obtaining a plurality of density differences between 
said reference pixel and each of said comparison pixels; 

determining a density difference that is closest to 0 
as a specific density difference; and 

applying said specific density difference to a 
reference density of the image, 

2. The method of erasing repeated patterns in a 
dark/light image according to Claim 1, wherein the subject 
of inspection is a liquid crystal array panel* 

3. The method of erasing repeated patterns in a 
dark/light image according to Claim 1, wherein the subject 
of inspection is a plasma display panel. 



4. The method of erasing repeated patterns in a 
dark/light image according to Claim 1, wherein, in the step 
of demarcating the obtained image into a plurality of areas, 
the plurality of areas have a size of a predetermined number 

5 of pixels obtained in accordance with the pattern pitch of 
the repeated patterns in the dark/ light image. 

5. The method of erasing repeated patterns in a 
dark/light image according to Claim 1, wherein, in the step 
of determining a specific density difference, a mean value 

10 of the plurality of density differences between the 

reference pixel and the comparison pixels is determined as 
the specific density difference. 

6. A method of manufacturing electronic equipment 
devices at least including liquid crystal panels, plasma 

15 display panels, and semiconductor wafers, including an 

inspection process that is performed in accordance with the 
method of erasing repeated patterns as set forth in claim 1. 

7. A pattern defect inspection device comprising: 
an image pickup element that picks up an image of a 

20 subject of inspection; and 

a processing device that detects pattern defects by 
storing and processing dark/light image data obtained by 
image pickup of the inspection subject, wherein the 
processing device includes: 
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a unit for demarcating the obtained image into a 
plurality of areas, 

detecting a reference pixel in one of said demarcated 
areas , 

5 assigning a comparison pixel in each of the rest of 

said demarcated areas, and 

obtaining a plurality of density differences between 
said reference pixel and each of said comparison pixels; 
a unit for determining a density difference that is 
Q 10 closest to 0 as a specific density difference; and 
^ a unit for generating a pattern-erased image. 

} y 8. The pattern defect inspection device according to 

JT Claim 7, wherein the subject of inspection is a liquid 

crystal array panel. 
|j 15 9. The pattern defect inspection device according to 

O Claim 7, wherein the subject of inspection is a plasma 

display panel. 

10. The pattern defect inspection device according to 
Claim 7, wherein, instead of determining a density 
20 difference that is closed to 0 as a specific density 
difference, a mean value of the plurality of density 
differences between the reference pixel and the comparison 
pixels is determined as the specific density difference. 
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ABSTRACT OF THE DISCLOSURE 



An image of a subject of inspection is picked up, and 
this image is demarcated into a plurality of areas. Density 
differences are found between reference pixels and a 
plurality of comparison pixels in the demarcated areas, and 
a density difference that is closest to 0 is determined as a 
specific density difference. The specific density 
difference is then applied to the reference density in the 
image of the subject, whereby repeated patterns in the image 
are erased. 



Fig. 2 



IMAGE INPUT 



m 
m 
m 

& 

O 
M 

y 
u 

O 

a 



DENSITY 

DIFFERENTIAL 

DETECTION 



#1 



#2 



SPECIFIC DENSITY 

DIFFERENTIAL 

DETERMINATION 



PATTERN-ERASED 
IMAGE GENERATION 



DEFECTS DETECTION 



#3 



#4 



#5 





size 


size 


size 


size 














i 

/ 
/ 
/ 
/ 
/ 

% 


. ( 

1: 


) 
3 


\ 


( 

V 


4 


1 
1 


n 


3 


/ 
/ 
/ 
/ 

<>. 

A 
/ 


; 

1 


I 

1 


j 

/ 
/ 


! 

1 


2 











Fig. 4 A 



20 



\ 



22 



21 



Fig. 4 B 




Fig. 5 A 
Prior Art 



size 56 50 




9in 



9(in+size) 



Fig. 5 B 
Prior Art 




o 

gradation 



Fig. 
Prior 



6 A 
Art 



/ 



/ 
/ 

\ 



I 

/ 
/ 

A 



I 



Fig. 6 B 
Prior Art 

.size. 



Declaration and Power of Attorney For Utility or Design Patent Application 

Japanese Language Declaration 



X& } 0, 



As a below named inventor, i hereby declare that: 

My residence, post office address and citizenship are as stated 
beiow next to my name. 

I believe I am the original, first and sole inventor (if only one name is 
listed below) or an original, first and joint inventor (if plural names 
are listed below) of the subject matter which is claimed and for 
which a patent is sought on the invention entitled 

"Method of Erasing Repeated Patterns 
and Pattern Defect Inspection Device" 



the specification of which is attached hereto unless the following 
box is checked: 



_b traffic ti. 



t u 



□ was filed on 



United States Application Number, 
and was amended on 



. (if applicable) or, 



t u 



< x t mmmn^i * m*m& l £pcT[ii^£Jii^is[# ^mi^^u, 



Prior foreign applications 
■')£<?> ftm&M 

11-218606 Japan 

(Number) (Country) 
m^) (U£) 



PCT International Application Number 
and was amended on 



. (if applicable). 



02/08/1999 



I hereby state that I have reviewed and understand the contents 
of the above identified specification, including the claims, as 
amended by any amendment referred to above. 

I acknowledge the duty to disclose information which is material to 
patentability as defined in Title 37, Code of Federal Regulations, 
§1.56. 

I hereby claim foreign priority under Title 35, United States Code 
§1 19(a-d) or §365(b) of any foreign application(s) for patent or 
inventor's certificate, or §365(a) of any PCT international application 
which designated at least one country other than the United States, 
listed below. I have also identified below, by checking the "No" 
box, any foreign application for patent or inventor's certificate, or of 
any PCT international application having a filing date before that of 
the application on which priority is claimed; Priority claimed 



(Day/Month/Year 



Filed) 



(Number) 



(Country) 



(Day/Month/Year 



Filed) 



Yes 
AO 

□ 
Yes 
AO 



□ 
No 

□ 
No 



□ ^(Dm^nmmmmmnimmcom.mimmm^xmmi'^o 



□ Additional foreign application numbers are listed on a 
supplemental priority sheet attached hereto. 



Page 1 of 4 



Japanese Language Utility or Design Patent Application Declaration 



{Application No.) 



{Application No.) 



{Application No.) 



(Application No,) (Day/Month/Year Filed) 



(Application No.) (Day/Month/Year Filed) 



Lio <fc tfffi i* § Kffio TfTo ^K52E^*HT* § Hi 



i hereby claim the benefit under Title 35, United States Code §1 1 9(e) 
of any United States provisional appiication(s) listed below. 



□ Additional provisional application numbers are listed on a 
supplemental priority sheet attached hereto. 

I hereby claim the benefit under Title 35, United States Code §1 20 
of any United States application(s), or §365(c) of any PCT 
international application designating the United States, listed below 
and, insofar as the subject matter of each of the claims of this 
application is not disclosed in the prior United States or PCT 
international application in the manner provided by the first 
paragraph of Title 35, United States Code §11 2, 1 acknowledge the 
duty to disclose information which is material to patentability as 
defined in Title 37, Code of Federal Regulations §1 .56 which became 
available between the filing date of the prior application and the 
national or PCT international filing date of this application. 



(mm (status) 

(4Wv£^ $^4* SSc^iS*) (patented, pending, abandoned) 



(%Lfo) (Status) 
(&lfr$r&, Wt%£x&&) {patented, pending, abandoned) 



□ Additional U.S. or international application numbers are listed 
on a supplemental priority sheet attached hereto. 

I hereby declare that ail statements made herein of my own 
knowledge are true and that ail statements made on information 
and belief are believed to be true; and further that these statements 
were made with the knowledge that willful false statements and the 
like so made are punishable by fine or imprisonment, or both, under 
Section 1001 of Title 18 of the United States Code and that such 
willful false statements may jeopardize the validity of the application 
or any patent issued thereon. 

The undersigned hereby authorizes the U.S. attorney or agent 
named herein to accept and follow instructions from either his foreign 
patent agent or corporate representative, if any, as to any action to 
be taken in the Patent and Trademark Office regarding this 
application without direct communication between the U.S. attorney 
or agent and the undersigned. In the event of a change in the 
persons from whom instructions may be taken, the U.S. attorney 
or agent named herein will be so notified by the undersigned. 



(Day/Month/Year Filed) 



(Day/Month/Year Filed) 



(Day/Month/Year Filed) 



Page 2 of 4 



Japanese Language Utility or Design Patent Application Declaration 



ffl § # # 7055 

Neil F. Greenblum 
Bruce H. Bernstein 
James L. Rowland 
Arnold Turk 



POWER OF ATTORNEY: As a named inventor, I hereby appoint 
the attorney(s) and/or agent(s) associated with the Customer 
Number provided below to prosecute this application and 
transact all business in the Patent and Trademark Office 
connected therewith, and direct that all correspondence be 
addressed to that Customer Number: 

CUSTOMER NUMBER 7055 

The appointed attorneys presently include: 

Reg. No. 28,394 
Reg. No. 29,027 
Reg. No. 32,674 
Reg. No. 33,094 



Address: GREENBLUM & BERNSTEIN, P.L.C, 

1941 ROLAND CLARKE PLACE 
RESTON, VA 20191 



Direct Telephone Caiis to: {name and telephone number) 



GREENBLUM & BERNSTEIN, P.L.C. 

(703)716-1191 





Full name of sole or first inventor 
Noriaki Yukawa 




Inventor's signature * Date 
Vl#7V 3(4 /<& Op t) r 06)06/c$ 


im 


Residence 8-1-43-1 J04, Tanimachi, Chuo-ku, 
Osaka-shi, Osaka 542-0012 JAPAN 


mm 


Citizenship 
Japan 




Post Office Address 
c/o MATSUSHITA ELECTRIC INDUSTRIAL CO. , LTD. 




1006, Oaza Kadoma , Kadoma-shi , Osaka 
571-8501 JAPAN 




Full name of second joint inventor, if any 
Hajime Kawano 




Second Inventor's signature Date 


im 


Residence 4-1-3-204, Denpo, Konohana-ku, 
Osaka-shi, Osaka 554-0002 JAPAN 


mm 


Citizenship 
Japan 




Post Office Address 
c/o MATSUSHITA ELECTRIC INDUSTRIAL CO. , LTD. 




1006, Oaza Kadoma, Kadoma-shi, Osaka 571-8501 
JAPAN 


(m^£tz{Z^Hm$0&m^m^l~ttl'X&mm&mm (Supply similar information and signature for third and 
h £ t/H £ £ W&lr -5 z. t o ) . subsequent joint inventors.) 

Page 3 of 4 



Japanese Language Utility or DesignPatent Application Declaration 





Full name of third inventor, if any 
Yukihiro Ayaki 




Thjod inventor's signature ^ Date 




Residence 1-1-C26-813, Takemidai, Suita-shi, 
Osaka 565-0863 JAPAN 


mm 


Citizenship 
Japan 




Post Office Address 

c/o MATSUSHITA ELECTRIC INDUSTRIAL CO. , LTD. 




1006, Oaza Kadoma, Kadoma-shi # Osaka 
571-8501 JAPAN 




Fuil name of fourth inventor, if any 




Fourth inventor's signature Date 




Residence 


LDfl 


Citizenship 




Post Office Address 


n 






Fuli name of fifth inventor, if any 




Fifth inventor's signature Date 


H$F/r 


Residence 


Hit 


Citizenship 




Post Office Address 








Fuil name of sixth inventor, if any 




Sixth Inventor's signature Date 




Residence 


mm 


Citizenship 




Post Office Address 






(%fr£M<n&mfflR%\~it\* LTfeiatt&WfR (Supply similar information and signature for subsequent joint 
fc £ ? £ * ffiSk* ZZbo) inventors.) 
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